Uncorrelated feature encoding for faster image style transfer

نویسندگان

چکیده

Recent image style transfer methods use a pre-trained convolutional neural network as their feature encoder. However, the is not optimal for but rather classification. Furthermore, they require time-consuming alignment to consider existing correlation among channels of encoded map. In this paper, we propose an end-to-end learning method that optimizes both encoder and decoder networks task relieves computational complexity correlation-aware alignment. First, performed updates only also parameters in training phase. Second, addition previous content losses, uncorrelation loss, i.e., total coefficient responses channels. Our loss allows generate map without correlation. Subsequently, our results faster forward processing with light-weighted transformer correlation-unaware Moreover, drastically reduced channel redundancy during process. This provides us possibility perform elimination negligible degradation generated quality. applicable multiple scaled by using cascade scheme user control strength through usage content-style trade-off parameter.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Real-time Image Style Transfer

Artistic style transfer has long been an interesting topic in computer vision research. Recently several methods for style transfer based on convolutional neural networks have been proposed. This project aims at understanding and implementing some of the existing methods. More specifically we succeed in implementing the optimization based neural algorithm as well as the real-time style transfer...

متن کامل

Neural Stereoscopic Image Style Transfer

Neural style transfer is an emerging technique which is able to endow daily-life images with attractive artistic styles. Previous work has succeeded in applying convolutional neural network (CNN) to style transfer for monocular images or videos. However, style transfer for stereoscopic images is still a missing piece. Different from processing a monocular image, the two views of a stylized ster...

متن کامل

Universal Style Transfer via Feature Transforms

Universal style transfer aims to transfer any arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or compromised visual quality. In this paper, we present a simple yet effective method that tackles these limitations without training on any pre-defined styles. The...

متن کامل

Face Sketch Synthesis with Style Transfer using Pyramid Column Feature

In this paper, we propose a novel framework based on deep neural networks for face sketch synthesis from a photo. Imitating the process of how artists draw sketches, our framework synthesizes face sketches in a cascaded manner. A content image is first generated that outlines the shape of the face and the key facial features. Textures and shadings are then added to enrich the details of the ske...

متن کامل

Visibility of uncorrelated image noise

In this study, we evaluated the effect that pixel size has upon people’s preferences for images. We used multispectral images of faces as the scene data and simulated the response from sensors with different pixel size while the other sensor parameters were kept constant. Subjects were asked to choose between pairs of images; we found that preference judgments were primarily influenced by the v...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neural Networks

سال: 2021

ISSN: ['1879-2782', '0893-6080']

DOI: https://doi.org/10.1016/j.neunet.2021.03.007